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Following  initial  experimental  histories  under  schedules  of  food 
presentation,  electric  shock  postponement,  or  electric  shock  termination, 
lever  pressing  in  squirrel  monkeys  may  be  maintained  under  intermittent 
schedules  of  electric  shock  presentation.  Rates  and  patterns  of 
responding  are  similar  to  those  that  ordinarily  characterize  responding 
under  similar  intermittent  schedules  of  food  or  water  presentation. 

At  present,  there  remains  to  be  developed  a comprehensive  theoretical 
framework  from  which  may  be  derived  precise  predictions  concerning  the 
conditions  under  which  response-dependent  presentation  of  electric  shock 
produces  comparable  or  contrasting  results  to  those  engendered  by  food 
or  water  presentation.  The  absence  of  such  a framework  suggests  a need 
for  further  research  designed  to  examine  the  "boundary  conditions"  under 
which  responding  may  be  maintained  by  shock  presentation.  Presumably, 
such  experiments  may  provide  sufficient  definition  to  the  empirical 
structure  to  generate  a predictive  theoretical  account.  The  present 
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experiment  sought  to  determine  whether  responding  could  be  maintained 
under  second-order  schedules  in  which  shock  presentation  was  dependent, 
not  upon  the  emission  of  simple  responses  such  as  individual  lever  presses, 
but  upon  sequences  of  responses  that  in  themselves  may  be  conceptualized 
as  units  of  behavior. 

Two  monkeys  were  initially  exposed  to  a sequence  schedule  of  the 
form  Seq  FI  8-min  (FI  2 -min).  That  is,  the  first  lever  press  after  2 
min  in  the  presence, of  four  component  stimuli  produced  either  (1) 
the  next  component  stimulus--if  less  than  eight  min  had  elapsed  since  the 
beginning  of  the  overall  FI  8-min  schedule,  or  (2)  immediate  electric 
shock  presentation--if  8-min  or  more  had  elapsed  since  the  beginning  of 
the  overall  FI  8-min  schedule.  The  Seq  FI  8-rnin  (FI  2-min)  schedule 
remained  in  effect  until  rate  of  responding  and  the  percent  of  shocks 
delivered  in  each  of  the  four  components  were  clearly  stable.  Both  mon- 
keys we> e then  exposed  to  a schedule  under  which  the  number  of  component 
completions  required  for  each  shock  presentation  was  determined  on  the 
basis  of  performance  during  the  Seq  FI  8-min  (FI  2-min)  phase.  This 
schedule  remained  in  effect  until  no  systematic  trends  in  rate  of 
responding  in  any  of  the  four  components  were  detected.  Both  monkeys 
were  returned  to  the  Seq  FI  8-min  (FI  2-min)  schedule  until  rate  of 
responding  in  each  of  the  four  components  appeared  clearly  stable  for 
fifteen  sessions,  and  were  next  exposed  to  a Seq  FR  4 (FI  2-min)  schedule 
under  which  four  component  completions  were  required  for  shock  presentation. 

Manipulations  of  schedule  variables  produced  changes  in  responding 
comparable  to  those  obtained  with  other  operant  responses  and  other 
maintaining  events,  lending  considerable  support  to  general  notions  that 
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the  schedule  under  which  an  event  is  presented  is  a fundamental  deter- 
minant of  the  way  presentation  of  that  event  affects  subsequent  behavior. 
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INTRODUCTION 


Certain  environmental  stimuli,  such  as  food  and  water,  usually  main- 
tain responses  which  produce  them  (positive  reinforcement)  and  suppress 
responses  which  remove  or  postpone  them  (punishment).  Other  stimuli 
(e_.£. , electric  shock)  usually  have  the  opposite  effects:  responding 

is  ordinarily  suppressed  by  shock  presentation  (punishment)  and  maintained 
by  shock  termination  or  postponement  (negative  reinforcement).  These 
effects  have  been  well  documented  across  a wide  range  of  experimental 
conditions  and  the  inherently  positive  and  negative  properties  of  food 
and  shock  have  been  frequently  considered  to  be  modulated  only  quantita- 
tively by  the  cicumstances  under  which  they  are  either  presented  or 
withdrawn  (cf . , Kimble,  1961;  Millenson,  1967;  Rachlin,  1970;  Schwartz, 
1978). 

Recently,  however,  relativistic  conceptualizations  of  reinforcement 
and  punishment  have  been  advanced  by  Morse  and  Kelleher  (1970,  1977)  and 
others  (e.£. , Morse,  McKearney,  and  Kelleher,  1977).  They  propose  that 
the  properties  of  stimuli  are  not  immutable,  and  that  the  operations 
described  above  may  have  qualitatively  different  effects,  depending  upon 
certain  characteristics  of  the  contingencies  relating  ongoing  behavior 
to  stimulus  presentation  or  termination.  Drawing  from  an  experimental 
literature  on  the  behavioral  effects  of  presenting  and/or  terminating 
stimuli  ranging  from  certain  drugs  (Cappell  and  LeBlaric,  1971;  Goldberg, 
Hoffmeister,  Schlichting,  and  Wuttke,  1971),  to  subcortical  brain 
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stimulation  (e.£. , Steiner,  Beer,  and  Shaffer,  1969),  to  noxious  electric 
shock  (£.£.,  Barrett  and  Glowa,  1977;  Barrett  and  Spealman,  1978;  Kelleher 
and  Morse,  1968;  McKearney,  1972a_),  these  theorists  have  reviewed  a rather 
large  number  of  experiments  indicating  that  presentation  of  a given  stim- 
ulus may  either  suppress  or  maintain  responding,  depending  upon  a number 
of  historical  and  current  variables.  Interactions  among  experimental 
histories,  the  quantitative  properties  of  ongoing  behavior  at  the  time  at 
which  an  environmental  event  is  introduced,  and  the  schedule  under  which 
a given  stimulus  may  be  either  presented  or  withdrawn,  have  been  suggested 
to  be  fundamental  determinants  of  whether  the  resultant  behavioral  process 
exemplifies  reinforcement  or  punishment  (cf . , Morse  and  Kelleher,  1970, 

1977). 

The  experimental  literature  on  the  maintenance  of  responding  by  inter- 
mittent presentations  of  electric  shock  provides  the  greatest  support  for 
this  general  viewpoint.  A large  number  of  studies  have  shown  similarities 
between  responding  maintained  by  presentation  of  electric  shock  and  that 
maintained  by  presentation  of  food  or  water.  These  similarities  include: 

(1)  characteristic  rates  and  patterns  of  responding  maintained  under  fixed- 
interval  (FI)  (DeWeese,  1977;  Kelleher  and  Morse,  1968,  1969;  McKearney, 

1968,  1969,  1972b/,  Malagodi,  DeWeese,  Webbe,  and  Palermo,  1973;  Malagodi, 
Gardner,  and  Palermo,  1978;  Morse,  Mead,  and  Kelleher,  1967;  Stretch,  Orloff, 
and  Dalrymple,  1968;  Stretch,  Orloff,  and  Gerber,  1970),  variable-interval 
(VI)  (Bacotti,  1978;  Barrett,  1975;  Barrett  and  Spealman,  1978;  McKearney, 

1 972a_,  1974b/  Malagodi  et  al_. , 1973b/  Webbe,  1974),  concurrent  VI  VI 
(Malagodi  et  al . , 1973b/  Webbe,  1974),  and  multiple  fixed-interval,  fixed- 
ratio  (McKearney,  1970)  schedules  of  electric  shock  presentation;  (2)  an 
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inverse  relationship  between  rate  of  responding  and  parameter  value  of 
FI  schedules  (McKearney,  1969;  Malagodi  et  al_. , 1973b);  (3)  a direct  rela- 
tionship between  rate  of  responding  and  shock  intensity  (Kelleher  and 
Morse,  1968;  McKearney,  1969);  (4)  a decrease  in  rate  of  responding 
following  introduction  of  a brief  delay  between  the  effective  response 
and  shock  presentation  (Byrd,  1972);  (5)  the  cessation  of  responding  during 
extinction  with  subsequent  recovery  of  performance  following  reintro- 
duction of  an  FI  schedule  of  shock  presentation  (Kelleher  and  Morse,  1968; 
McKearney,  1969);  (6)  the  maintenance  of  a higher  rate  of  responding  when 
shocks  are  delivered  response-dependently  than  when  they  are  delivered 
response-independently  (Bacotti,  1978;  McKearney,  1974a_;  Malagodi  et  a1_. , 
1978;  Morse  and  Kelleher,  1970);  and,  (7)  an  increasing-decreasing 
function  relating  measures  of  schedule-induced  hose-biting  to  parameter 
value  of  FI  schedules  (Malagodi  et  a]_. , 1973^;  DeWeese,  1977).  These 
and  other  similarities  have  led  most  investigators  to  interpret  responding 
maintained  by  schedules  of  electric  shock  presentation  in  terms  of  the 
processes  that  ordinarily  operate  to  govern  schedule-controlled  performance 
when  food  or  water  are  presented  and,  accordingly,  to  conceptualize  these 
results  as  exemplifying  the  process  of  positive  reinforcement  (e.£. , 

Barrett  and  Spealman,  1978;  Byrd,  1972;  Kelleher  and  Morse,  1968; 

McKearney,  1968,  1969,  1970,  1972a_,  1 97 2b^;  Malagodi,  Gardner,  and  Palermo, 
1978;  Morse  and  Kelleher,  1970,  1977). 

Although  the  experimental  results  reviewed  above  demonstrate  that 
there  are  indeed  many  conditions  under  which  resDonse-dependent  presen- 
tations of  electric  shock  generate  behavioral  effects  comparable  to  those 
engendered  under  analagous  conditions  of  food  or  water  presentation,  it 
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would  be  a misleading  simplification  to  conclude,  at  this  time,  that 
presentation  of  electric  shock  may  be  conceptualized  as  a positively 
reinforcing  operation  in  the  same  sense  one  ordinarily  classifies  food 
or  water  presentation.  Presentation  of  electric  shock  may  have  effects 
that  differ  markedly  from  those  of  food  or  water  presentation  even 
under  conditions  in  which  responding  is  maintained  by  shock  presentation. 
Whereas  the  effect  of  following  each  response  with  food  or  water  presen- 
tation is  usually  the  maintenance  of  responding  at  maximum  frequency,  the 
comparable  arrangement  with  shock  presentation  is  usually  suppression  of 
responding  (Kelleher  and  Morse,  1968;  McKearney,  1972aJ.  While  concurrent 
schedules  of  food  reinforcement  frequently  yield  "matching"  relationships 
between  relative  response  rates  and  relative  frequencies  of  stimulus 
presentation  (cf . , Catania,  1966;  deVilliers,  1977),  concurrent  schedules 
of  shock  presentation  may  produce  different  results  (Webbe,  1974). 

Although  administration  of  certain  drugs,  such  as  d^-amphetamine , may 
show  consistent  effects  on  FI  responding,  independently  of  whether  responding 
is  maintained  by  food  or  shock  presentation,  the  effects  of  other  drugs 
(<5.£. , morphine)  may  be  dependent  upon  whether  food  or  shock  presentation 
is  maintaining  responding  (Barrett,  1976;  McKearney,  1974). 

At  present,  there  remains  to  be  developed  a comprehensive  theoretical 
framework  from  which  may  be  derived  precise  predictions  concerning  tne 
conditions  under  which  response-dependent  presentation  of  electric  shock 
produces  comparable  or  contrasting  results  to  those  engendered  by  food  of 
water  presentation.  The  absence  of  such  a framework  suggests  a need  for 
further  research  designed  to  examine  the  "boundary  conditions"  under  which 
responding  may  be  maintained  by  shock  presentation.  Presumably,  such 
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experiments  may  provide  sufficient  definition  to  the  empirical  structure 
to  generate  a predictive  theoretical  account.  The  present  experiment 
sought  to  determine  whether  responding  could  be  maintained  under  second- 
order  schedules  in  which  shock  presentation  was  dependent,  not  upon  the 
emission  of  simple  responses  such  as  individual  lever  presses,  but  upon 
sequences  of  responses  that  in  themselves  may  be  conceptualized  as  units 
of  behavior  (cf. , Gollub,  1977;  Kelleher,  1966^,  j^;  Marr,  1969). 

Second-order  schedules  terminating  in  food  presentation  have  been  valuable 
procedures  for  examining  the  degree  to  which  schedule  variables  demon- 
strated to  operate  at  a "simple"  level  of  analysis  (i_.e_. , single  key  pecks) 
similarly  operate  at  more  complex  levels  ( i_.e_. , sequences  of  responses 
and  stimuli).  In  general,  these  experiments  have  revealed  great  gener- 
ality across  these  differing  levels  of  analyses  in  the  schedule  variables 
governing  temporal  sequencing  of  behavior  (£.£.,  Davison,  1969;  Findley, 

1962;  Malagodi,  Webbe,  and  Waddell,  1975;  Marr,  1971;  Shull,  Guilkey, 
and  Witty,  1972;  Webbe  and  Malagodi,  1978).  Similar  extensions  of  gener- 
ality to  conditions  under  which  responding  is  maintained  by  presentation 
of  electric  shock  would  increase  the  range  of  conditions,  and  levels  of 
complexity,  under  which  such  responding  compares  favorably  with  that 
engendered  under  similar  conditions  of  food  or  water  presentation.  The 
failure  to  find  comparable  effects,  of  course,  would  be  helpful  in 
delineating  boundary  conditions,  and  might  suggest  the  variables 
responsible. 

Previous  experiments  with  second-order  schedules  terminating  in  shock 
presentation,  utilizing  brief-stimulus  arrangements,  have  yielded  conflicting 
results.  In  one  experiment  (Byrd,  1969),  key  pressing  in  cats  was  main- 
tained under  conditions  in  which  shock  was  presented  following  completion 
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of  three  successive  FI  5-min  components--FR  3 (FI  5-min).  In  one  exper- 
imental phase,  a brief  burst  of  white  noise  occurred  at  completion  of  the 
first  two  components,  but  not  at  completion  of  the  third,  when  shock  was 
presented  (nonpaired-stimulus  condition).  In  another  phase,  the  brief 
presentation  of  white  noise  occurred  at  completion  of  all  three  components 
(paired-stimulus  condition).  Responding  was  suppressed  within  and  through- 
out components  under  the  paired-stimulus  condition  in  comparison  with 
both  the  nonpaired-stimulus  condition  and  a condition  under  which  white 
noise  was  not  presented  at  completion  of  components.  These  results  are 
in  contrast  to  those  ordinarily  engendered  by  similar  second-order  brief- 
stimulus  schedules  terminating  in  food  presentation  (£•£.,  Kelleher, 

1966^,  b_;  Malagodi,  DeWeese,  and  Johnston,  1973),  and  to  those  obtained 
in  a second  experiment  (Byrd,  1972)  in  which  lever  pressing  in  squirrel 
monkeys  was  maintained  under  similar  conditions.  In  that  experiment, 
responding  was  enhanced  within  FI  components  under  paired-stimulus  condi- 
tions in  comparison  with  nonpaired-stimulus  conditions. 

The  present  experiment  examined  responding  under  second-order 
schedules  similar  to  those  previously  examined  by  Byrd  in  that  shock 
presentation  was  dependent  upon  completion  of  FI  components.  The  experi- 
ment differed  in  that  another  form  of  second-order  schedule--a  sequence 
schedule--was  studied.  In  a second-order  sequence  schedule,  different 
discriminative  stimuli  are  presented  throughout  successive  components 
(Marr,  1971).  The  experiment  sought  to  determine  whether:  (a)  responding 

could  be  maintained  under  conditions  in  which  shock  presentation  was 
dependent  upon  completion  of  components,  each  associated  with  presentation 
of  a different  discriminative  stimulus;  (b)  such  responding,  if  maintained, 
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resembled  that  previously  found  under  comparable  conditions  of  food 
presentation  (e.£. , Marr,  1971);  and  (c)  patterns  of  responding  within 
and  throughout  sequences  of  components  varied  with  manipulations  of 
dependencies  of  shock  presentation  in  a manner  comparable  to  those 
ordinarily  engendered  by  similar  manipulations  of  dependencies  under 
both  simple  and  second-order  schedules  of  food  presentation. 


METHOD 


Subjects 

Two  adult  male  squirrel  monkeys  (Saimiri  sciurus),  SM-38  and  SM-39, 
served.  Food  and  water  were  continuously  available  in  their  individual 
home  cages. 

Apparatus 

A Plexiglas  chair,  similar  to  the  one  described  by  Hake  and  Azrin 
(1963),  was  enclosed  within  a ventilated,  sound-attenuating  chamber  simi- 
lar to  that  described  by  Weiss  (1970).  Each  monkey  was  restrained  in  the 
seated  position  by  a waist  lock,  with  its  tail  held  motionless  in  a small 
stock.  A BRS-Foringer  (model  SG-901)  constant-current  ac  shock  generator 
delivered  electric  shock  of  100  msec  duration  and  6 mA  intensity  (300  V, 
60  Hz,  through  a series  resistance  of  50  K ohms)  to  two  hinged  brass 
plates  that  rested  on  a shaved  portion  of  the  tail.  Electrode  paste 
(Grass  EC-2)  insured  low  resistance  between  the  tail  and  brass  plates. 

•A  lever  (Lehigh  Valley  #1352)  was  mounted  on  the  left  side  of  the  front 
wall,  6.0  cm  above  the  waist  plate.  Lever  presses  with  a downward  force 
greater  than  0.2  N registered  as  responses  and  briefly  operated  a feed- 
back relay.  Illumination  was  provided  by  four  pairs  of  7-w  115  V ac 
'nouselights  (yellow,  blue,  red,  and  white)  located  at  the  top  of  the 
front  wall.  White  noise  was  present  in  the  chamber  except  when  other- 
wise indicated.  Electromechanical  programming  and  recording  equipment 
was  located  in  an  adjoining  room. 
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Procedure 

Pre-experimental  histories.  Lever  pressing  was  established  following 
the  general  procedures  described  by  McKearney  (1968).  In  the  presence 
of  yellow  houselights  an  avoidance  schedule  was  in  effect:  shocks  were 

delivered  every  5 sec  in  the  absence  of  responding,  and  each  response 
postponed  scheduled  shocks  for  20  sec  (Sidman,  1953).  Sessions  lasted 
90  min.  After  19  sessions  with  Monkey  SM-38,  and  seven  sessions  with 
Monkey  SM-39,  a fixed-interval  (FI)  schedule  of  electric  shock  presenta- 
tion was  added  to  the  avoidance  schedule.  The  value  of  the  FI  schedule 
was  10-mi n for  Monkey  SM-38  and  8-min  for  Monkey  SM-39.  Under  these 
conjoint  schedules  of  shock  postponement  and  shock  presentation,  lever 
presses  continued  to  postpone  shocks  scheduled  according  to  the  avoidance 
component,  and  the  first  response  after  the  fixed  interval  had  elapsed 
resulted  in  immediate  shock  presentation  and  initiated  another  fixed 
interval.  Sessions  terminated  after  the  fifteenth  response-produced 
shock.  After  10  and  two  sessions  under  the  conjoint  schedule  the  avoid- 
ance component  was  removed,  leaving  the  FI  10-mi n or  FI  8-min  scnedu'ie 
for  Monkeys  SM-38  and  SM-39,  respectively,  as  the  only  programmed  conse- 
quences of  responding.  After  15  and  22  sessions  under  the  FI  schedules, 
the  monkeys  were  exposed  to  various  experimental  manipulations  before 
beginning  the  present  experiment.  Monkey  SM-38  responded  under  several 
second-order  brief-stimulus,  VI,  concurrent  VI  VI,  and  two-  and  three- 
component  tandem  and  chained  schedules  of  electric  shock  presentation  for 
over  one  thousand  experimental  sessions  of  varying  durations--the  VI  and 
concurrent  VI  VI  procedures  are  detailed  in  Webbe  (1974).  Monkey  SM-39 
responded  under  several  multiple  and  second-order  schedules  of  electric 
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shock  presentation,  containing  FI  2-min  schedules  as  components,  for 
approximately  100  experimental  sessions  of  between  two  and  three  hours 
duration. 

Experimental  procedures.  After  the  procedures  briefly  described 
above,  both  monkeys  were  exposed  to  a sequence  schedule  of  the  form 
Seq  FJ  8-min  (FI  2-min).  That  is,  the  first  lever  press  after  2 
min  in  the  presence  of  each  component  stimulus  produced  either  (1) 
the  next  component  stimulus--if  less  than  8 min  had  elapsed  since  the 
beginning  of  the  overall  FI  8-min  schedule,  or  (2)  immediate  electric 
shock  presentation--if  8 min  or  more  had  elapsed  since  the  beginning  of 
the  overall  FI  8-min  schedule.  Fifteen-second  timeouts  followed  each 
shock  presentation.  During  timeouts  the  chamber  was  dark,  white  noise 
was  absent,  a clicking  sound  was  present,  and  responses  had  no  scheduled 
consequences.  After  each  timeout  another  overall  FI  8-min  interval  was 
begun;  the  yellow  houselights  were  illuminated  first  and  the  order  of 
component  stimuli  was  always  yellow  (S^),  blue  (S^),  red  (S^),  and  white 
(S^)  (cf . , Marr,  1971).  Thus,  shock  could  be  delivered  in  the  presence 
of  any  of  the  four  component  stimuli  depending  on  how  much  time  had 
elapsed  within  the  overall  FI  8-min  schedule  at  the  time  of  component 
completion.  The  Seq  FI  8-min  (FI  2-min)  schedule  remained  in  effect  until 
rate  of  responding  and  the  percent  of  shocks  delivered  in  each  of  the 
four  components  were  clearly  stable  for  24  (Monkey  SM-38)  or  25  (Monkey 
SM-39)  sessions.  Both  monkeys  were  then  exposed  to  a scnedule  under 
which  the  number  of  component  completions  required  for  each  shock  presen- 
tation was  determined  on  the  basis  of  performance  during  the  Seq  FI  8-min 
(FI  2-min)  phase.  For  each  of  the  last  24  or  25  sessions  of  stable 
responding  a "yoked"  session  was  derived  during  which  shocks  were  programmed 
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to  occur,  on  an  interval-by-interval  basis,  after  the  same  number  of 
component  completions  as  had  been  obtained  during  a corresponding  matched 
session  under  Seq  FI  8-min  (FI  2-min).  Thus,  shocks  were  delivered  with 
the  same  frequency  in  the  presence  of  the  different  component  stimuli  as 
during  the  previous  phase,  and  after  the  same  number  of  component  com- 
pletions, on  the  relatively  time-independent  basis  of  the  variable  number 
of  components  completed  in  a previous  session.  This  schedule  will  be 
referred  to  as  a sequence  variable-ratio  "yoked"  schedule--Seq  VR  yoked 
(FI  2-min).  The  Seq  VR  yoked  (FI  2-min) schedule  remained  in  effect  until 
no  systematic  trends  in  rate  of  responding  in  any  of  the  four  components 
were  detected,  and  until  a full  complement  of  24  or  25  yoked  sessions 
was  completed.  Both  monkeys  were  returned  to  the  Seq  FI  8-min  (FI  2-min) 
scnedule  until  rate  of  responding  in  each  of  the  four  components  appeared 
clearly  stable  for  fifteen  sessions,  and  were  next  exposed  to  a Seq  FR  4 
(FI  2-min)  schedule  under  which  four  component  completions  were  required 
for  shock  presentation.  The  Seq  FR  4 (FI  2-min)  schedule  remained  in 
effect  until  rate  of  shock  presentation  fell  below  two  shocks  per  hour. 
Monkey  SM-38  was  reexposed  to  the  Seq  FI  8-min  (FI  2-min)  conditions  until 
rate  of  responding  and  percent  of  shocks  delivered  in  each  of  the  four 
components  were  clearly  stable  for  15  sessions. 

Sessions  terminated  after  20  shock  presentations  under  the  FI  8-min 
and  VR  yoked  conditions,  and  after  either  20  shock  presentations  or  the 
first  shock  presentation  after  three  hours  had  elapsed  under  the  FR  4 
condition.  Sessions  were  usually  conducted  six  days  per  week. 

i he  order  of  experimental  conditions  and  the  number  of  sessions  under 


each  are  shown  in  Table  1. 
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TABLE  1 

Summary  of  procedures  and  number  of  sessions 
under  each 


Monkey 

Schedule  SM-38  SM-39 


FI 

8-mi  n 

(FI 

2 -min) 

67 

182 

VR 

yoked 

(FI 

2-min) 

48 

125 

FI 

8 -mi  n 

(FI 

2 -min) 

20 

37 

FR 

4 (FI 

2-rrr 

in) 

7 

55 

FI 

8 -min 

(FI 

2-min) 

138 

RESULTS 


The  present  results  may  be  analyzed  in  terms  of  changes  in  rate  of 
responding  across  the  sequence  of  component  schedules  and  in  terms  of 
patterns  of  responding  within  individual  components  (cf . , Malagodi  et  al . , 
1375;  Marr,  1969).  Figure  1 shows  average  rates  of  responding  in  the 
presence  of  each  of  the  four  component  stimuli  under  the  Seq  FI  8-min 
(FI  2-min)  schedule.  The  top  panel  summarizes  these  results  from  both 
exposures  to  the  FI  sequence  schedule  for  Monkey  SM-39  and  the  bottom 
panel  summarizes  results  from  the  three  exposures  to  the  FI  sequence 
schedule  for  Monkey  SM-38.  Note  that  the  ordinates  are  scaled  differently 
in  the  two  panels.  The  distribution  of  component  response  rates  across 
the  second-order  FI  8-min  schedule  was  similar  for  both  monkeys:  rate  of 

responding  was  low  in  the  presence  of  the  stimulus  associated  with  the 
first  FI  2-min  component  (S^),  increased  in  S^,  reach  a maximum  in  S£, 
then  decreased  somewhat  in  S-j . With  Monkey  SM-39,  rate  of  responding  in 
was  higher  than  rate  of  responding  in  during  25  of  the  30  sessions 
summarized.  With  Monkey  SM-38,  rates  of  responding  in  S£  and  S-j  were 
equal  during  one  session,  and  cannot  be  compared  during  one  other  session 
in  which  no  shocks  were  presented  in  S^ ; rate  of  responding  in  S^  was 
higher  than  rate  of  responding  in  S-j  during  38  of  the  remaining  43  sessions 
summarized.  While  the  intermediate  rate  in  S?  was  proportionately  higher 

J 

for  Monkey  SM-38  than  for  Monkey  SM-39,  the  general  shape  of  the  distribu- 
tion of  component  response  rates  was  the  same.  In  addition  to  this  simi- 
larity in  shape  of  the  distribution  between  monkeys.  Figure  1 points  out 
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that  component  response  rates  obtained  during  repeated  phases  under  the 
FI  schedule  closely  recaptured  initial  values.  That  is,  component 
response  rates  during  the  second  exposure  to  the  FI  sequence  schedule 
for  Monkey  SM-39,  and  during  the  second  and  third  exposures  to  the  FI 
sequence  schedule  for  Monkey  SM-38,  were  nearly  equivalent  to  those 
obtained  during  the  first  exposure  to  the  FI  schedule. 

Figure  2 shows  the  percentage  of  all  shock  presentations  that  occurred 
in  the  presence  of  each  of  the  four  component  stimuli  during  the  last  15 
days  of  each  exposure  to  the  Seq  FI  8-min  (FI  2-min)  schedule.  With 
Monkey  SM-39  (top  panel),  no  shock  presentations  occurred  in  either 
or  during  the  30  sessions  summarized.  With  Monkey  SM-38  (bottom  panel), 
essentially  a zero  percentage  of  the  shock  presentations  occurred'in  S^, 
and  approximately  10  percent  occurred  in  S^  during  the  45  sessions  summa- 
rized. With  both  monkeys,  the  great  majority  of  shock  presentations 
occurred  in  the  presence  of  the  last  two  component  stimuli:  approximately 

10  and  90  percent  for  Monkey  SM-39,  and  60  and  30  percent  for  Monkey  SM-38, 
were  delivered  in  S^  and  S^ , respectively. 

Figure  3 shows  average  rates  of  responding  in  the  presence  of  each 
of  the  four  component  stimuli  under  the  Seq  VR  yoked  (FI  2-min)  and 
Seq  FR  4 (FI  2-min)  schedules  (the  percentages  of  shocks  delivered  in  the 
presence  of  each  of  the  four  stimuli  under  the  VR  schedule  were  identical 
to  the  percentages  obtained  during  the  first  phase  under  the  FI  schedule 
since  the  value  and  distribution  of  the  VR  schedule  were  derived  on  the 
basis  of  performance  during  the  initial  FI  phase;  100  percent  of  all 
shocks  delivered  under  the  FR  schedule  occurred  in  the  presence  of  S^). 
Responding  under  the  VR  yoked  schedule  will  be  considered  first.  With 
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both  monkeys,  the  major  effect  of  changing  from  the  FI  8-min  to  the  VR 
yoked  second-order  schedule  was  a decrease  in  the  rate  of  responding  in 
S^.  This  decrease  was  found  to  be  reliable  in  comparisons  between  indi- 
vidual matched  pairs  of  sessions  (each  pair  was  comprised  of  an  FI  session 
and  its  corresponding  VR  session):  rate  of  responding  in  S2  was  higher 

during  the  FI  member  of  the  pair  for  24  of  the  last  25  possible  compari- 
sons with  Monkey  SM-39,  and  for  24  of  the  last  24  possible  comparisons 
with  Monkey  SM-38.  Rate  of  responding  in  the  other  three  components 
remained  relatively  unchanged.  The  overall  result  was  a distribution  of 
component  response  rates  that,  unlike  the  distribution  obtained  under 
Seq  FI  8-min  (FI  2-min)  which  peaked  in  S^,  increased  directly  from  to 
S-j.  The  average  VR  value  (number  of  components  per  shock  presentation) 
was  3.9  for  Monkey  SM-39  and  3.2  for  Monkey  SM-38  during  the  VR  yoked 
phase. 

Following  the  VR  yoked  phase,  the  FI  8-min  second-order  schedule  was 
reinstated  and  responding  essentially  identical  to  that  maintained  in  the 
first  FI  phase  was  recaptured  (see  Figures  1 and  2).  The  monkeys  were 
then  exposed  to  the  Seq  FR  4 (FI  2-min)  schedule.  Figure  3 shows  that 
under  the  FR  4 second-order  schedule  rates  of  responding  in  S^  through 
decreased  to  levels  lower  than  those  seen  during  previous  phases. 

Rate  of  responding  in  S^  increased  with  Monkey  SM-39  and  was  relatively 
unchanged  with  Monkey  SM-38  in  comparison  to  rate  of  responding  in  S^ 
during  the  preceding  FI  and  VR  phases.  As  under  the  VR  yoked  second- 
order  schedule,  the  distribution  of  component  response  rates  increased 
directly  from  S^  through  S-j . Following  the  FR.  4 phase,  the  FI  8-min 
second-order  schedule  was  reinstated  with  Monkey  SM-38  and  responding 
essentially  identical  to  that  maintained  in  the  first  and  second  FI 
phases  was  again  recaptured  (see  Figures  1 and  2). 
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Figures  4 and  5 show  cumulative  records  for  each  monkey  under  each 
of  the  three  forms  of  sequence  schedule.  Records  from  only  the  first 
exposure  to  the  FI  schedule  are  shown  since  the  other  exposures  yielded 
the  same  performances.  Record  A in  Figure  4 is  from  session  number  177  of 
Monkey  SM-39's  first  exposure  to  the  Seq  FI  8-min  (FI  2-min)  schedule. 
Responding  in  Sd  typically  consisted  of  a single  response  after  the  first 
FI  2-min  component  had  elapsed;  patterning  of  responding  was  erratic  in 
those  infrequent  instances  of  intervals  in  which  more  than  one  response 
was  emitted.  Responding  in  occurred  at  a somewhat  higher  rate,  often 
in  positively  accelerated  patterns.  While  considerable  interval -to- 
interval  variability  is  apparent  in  a prominent  characteristic  of 
responding  under  the  FI  sequence  schedule  was  the  frequent  occurrence  of 
high  response  rates.  The  pattern  of  responding  in  such  instances  consisted 
of  a short  pause  at  the  beginning  of  the  interval  which  was  followed  by 
acceleration  to  a sustained  rapid  rate  of  responding  that  terminated  with 
production  of  either  electric  shock  (as  at  point  a)  or  (as  at  points 
b^  and  c) . Responding  in  often  occurred  at  a lower  rate  than  responding 
in  $2,  primarily  due  to  the  occurrence  of  longer  initial  pauses.  Record 
B in  Figure  4 is  from  the  last  "yoked"  session  for  which  the  distribution 
of  component-shock  pairings  was  derived  from  the  session  shown  in  Record 
A.  The  letters  a_,  b_,  and  £ mark  corresponding  points  between  the  two 
records.  Responding  in  Sd  ‘again  generally  consisted  of  a single  response 
after  the  end  of  the  first  2-min  interval.  The  average  initial  pause 
duration  in  was  slightly  shorter  than  under  the  FI  schedule,  resulting 
in  a slightly  higher  rate  of  shock  presentation  (7.3  shocks  per  hour 
under  the  VR  schedule  versus  7.0  shocks  per  hour  under  the  FI  schedule). 
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Responding  in  was  at  a low  rate,  but  the  duration  of  rarely  exceeded 
the  2-min  minimum.  The  lower  average  rate  of  responding  engendered  in 
under  the  VR  schedule,  shown  previously  in  Figure  3,  can  be  seen  iri  the 
individual  components  of  Figure  4B.  Comparing  points  a_,  b^,  and  c^  between 
Records  A and  B in  Figure  4 shows  that  responding  in  still  occurred  in 
positively  accelerated  patterns,  but  that  initial  pauses  were  longer  and 
terminal  rates  were  generally  lower  than  those  engendered  under  the  FI 
sec.  ~ce  schedule.'  Responding  in  was  similar  to  that  previously 
maintained  under  the  FI  schedule  in  both  rate  and  pattern  of  responding. 
Record  C in  Figure  4 is  from  the  last  session  under  the  Seq  FR  4 (FI 
2-min)  schedule  for  Monkey  SM-39.  The  development  of  extended  pausing 
in  both  and  S^,  and  the  substantial  decrease  in  rate  of  responding  in 
may  be  seen.  The  interval  shown  at  d^  consisted  of  an  extended  pause 
followed  by  a single  response  in  S^.  Responding  maintained  in  was  at 
a higher  rate  than  in  previous  phases,  primarily  due  to  shorter  initial 
pauses. 

Figure  5 shows  cumulative  records  for  Monkey  SM-38  from  the  three 
forms  of  sequence  schedule,  illustrating  the  similarities,  and  some 
differences,  between  the  responding  of  the  two  monkeys.  Record  A in 
Figure  5A  is  from  session  number  64  of  Monkey  SM-38's  first  exposure  to 
the  Seq  FI  8-min  (FI  2-min)  schedule.  The  overall  rate  of  responding 
was  approximately  half  of  that  seen  with  Monkey  SM-39  in  Figure  4A. 
Responding  in  S^  was  similar  to  that  seen  with  Monkey  SM-39:  typically 

a single  response  wnich  was  emitted  after  the  first  2-min  interval  had 
elapsed  terminated  S^  and  produced  S^.  Responding  in  S^  generally  con- 
sisted of  a pause  followed  by  positively  accelerated  responding  that 
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terminated  with  production  of  either  electric  shock  (as  points  b.  and  c) 
or  (as  in  all  remaining  intervals  shown  in  Record  A).  Responding  in 
Sg  generally  occurred  in  similar  patterns  but  at  a higher  rate  than 
responding  in  Sg.  While  the  relatively  longer  initial  pause,  and  conse- 
quently lower  response  rate,  is  not  as  pronounced  in  the  pattern  of 
responding  in  with  this  monkey,  one  clear  instance  of  such  a pattern 
can  be  seen  at  point  a_.  Record  B in  Figure  5 is  from  the  last  "yoked" 
session  for  which  the  distribution  of  component-shock  pairings  was  derived 
from  the  session  shown  in  Record  A.  The  letters  a_,  b_,  and  £ again  mark 
corresponding  points  between  the  two  records.  Responding  in  generally 
consisted  of  a single  response  after  the  end  of  the  first  2-min  interval. 
The  average  pause  duration  was  longer  than  under  the  FI  schedule,  resulting 
in  a lower  rate  of  shock  presentation  (5.1  shocks  per  hour  under  the  VR 
schedule  versus  7.0  shocks  per  hour  under  the  FI  schedule).  Rate  and 
pattern  of  responding  in  Sg  was  similar  to  that  seen  under  the  FI  schedule, 
while  the  rate  of  responding  in  Sg  was  lower  than  that  seen  under  the  FI 
schedule.  Responding  in  S-j  was  essentially  unchanged.  Record  C in 
Figure  5 is  from  the  last  session  under  the  Seq  FR  4 (FI  2-min)  schedule. 
•It  shows  the  development  of  extended  pausing  in  S^,  and  a slight  decrease 
in  rate  of  responding  in  Sg  and  Sg.  Responding  maintained  in  S-,  was 
similar  to  that  maintained  in  S-j  in  all  previous  phases  of  the  experiment. 

The  cumulative  records  in  Figures  4 and  5 show  the  changes  in  rate  of 
responding  in  under  the  three  forms  of  sequence  schedule  more  clearly 
than  do  the  summary  graphs  in  Figures  1 and  3.  With  Monkey  SM-39,  average 
rates  of  responding  in  under  the  FI,  VR,  and  FR  schedules  were  0.7,  1.3, 
and  0.07  responses  per  minute,  respectively.  Comparable  values  for  Monkey 
SM-38  were  0.3,  0.2,  and  0.04  responses  per  minute. 
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Monkey  SM-39  rarely  responded  during  the  post-shock  timeouts,  while 
Monkey  SM-38  made  several  responses  in  rapid  succession  immediately  after 
most  shock  presentations. 


Figure  1.  Average  session  rates  of  responding  in  each  component  of 
the  FI  8-min  sequence  schedule.  Circles  represent  the  median  values  of 
the  last  fifteen  sessions  of  each  exposure.  Vertical  lines  through  the 
circles  represent  ranges;  absence  of  a vertical  line  indicates  that  the 
range  lies  within  the  area  occupied  by  the  circle.  The  top  frame  contains 
data  for  Monkey  SM-39  and  the  bottom  frame  contains  data  for  Monkey  SM-38. 
Leftmost  symbols  are  from  the  first  exposure,  and  symbols  from  subsequent 
exposures  are  displaced,  in  order,  to  the  right. 
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Figure  2.  Percentage  of  shock  presentations  that  occurred  at  comple- 
tion of  each  component  of  the  FI  8-min  sequence  schedule  for  Monkeys  SM-39 
(top  panel)  and  SM-38  (bottom  panel).  Circles  and  vertical  bars  represent 
medians  and  ranges  of  the  last  fifteen  sessions  of  each  exposure.  Left- 
most symbols  are  from  the  first  exposure,  and  symbols  from  subsequent 
exposures  are  displaced,  in  order,  to  the  right. 
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Figure  3.  Average  session  rates  of  responding  in  each  component  of 
the  VR  yoked  (squares)  and  FR  4 (triangles)  sequence  schedules.  Squares 
represent  median  values  of  the  last  fifteen  sessions  under  the  VR 
schedule  and  triangles  represent  median  values  of  the  last  three  sessions 
under  the  FR  schedule.  Vertical  lines  through  the  symbols  respresent 
ranges;  absence  of  a vertical  line  indicates  that  the  range  lies  within 
the  area  occupied  by  the  symbol.  The  top  frame  contains  data  for  Monkey 
SM-39  and  the  bottom  frame  contains  data  for  Monkey  SM-38. 
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Figure  4.  Representative  cumulative  records  for  Monkey  SM-39.  Diag- 
onal marks  of  the  response  pen  indicate  component  changes.  Resetting  of 
the  response  pen  to  baseline  indicates  shock  presentations.  The  event 
pen  was  displaced  downward  during  the  15-sec  timeouts  that  followed  each 
shock  presentation.  The  schedules  in  effect  were  Seq  FI  8-min  (FI  2-min) 
in  record  A,  Seq  VR  yoked  (FI  2-min)  in  record  B,  and  Seq  FR  4 (FI  2-min) 
in  record  C.  Details  of  record  selection  are  given  in  the  test. 
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Figure  5.  Representative  cumulative  records  for  Monkey  SM-38. 
Recording  conventions  are  the  same  as  those  in  Figure  4.  Schedules 
in  effect  were  Seq  FI  8-min  (FI  2-min)  in  record  A,  Seq  VR  yoked 
(FI  2-min)  in  record  B,  and  Seq  FR  4 (FI  2-min)  in  record  C. 
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DISCUSSION 


In  the  present  study  responding  was  maintained  under  three  second- 
order  schedules  in  which  the  presentation  of  noxious  electric  shock 
depended  upon  the  completion  of  sequences  of  component  schedules,  each 
associated  with  the  presence  of  a different  discriminative  stimulus. 
Analyses  of  the  present  results  may  be  related  to  previous  experimental 
findings  and  conceptualizations  within  the  areas  of  second-order  schedules, 
schedule-controlled  behavior  in  general,  and  shock-maintained  behavior. 

Performance  under  second-order  schedules  is  generally  analyzed  in 
terms  of  rates  and  patterns  of  responding  within  individual  components 
and  throughout  sequences  of  components.  These  aspects  of  responding  have 
been  shown  to  be  controlled  by  interactions  among:  (1)  the  form  and 

parameter  value  of  component  schedule;  (2)  the  form  and  parameter  value 
of  the  schedule  according  to  which  completion  of  components  results  in 
stimulus  presentation;  and  (3)  the  manner  of  presenting  exteroceptive 
stimuli  at  completion  of  components.  In  the  present  study,  performance 
within  individual  components  was  generally  characterized  by  either  a rela- 
tively long  pause  followed  by  a single  response  after  the  end  of  the  FI 
2-min  component  schedule,  or  by  a shorter  initial  pause  followed  by  posi- 
tively accelerated  responding  until  the  end  of  the  component.  With  few 
exceptions,  the  first  pattern  occurred  almost  exclusively  in  S^,  while 
the  second  pattern  occurred  in  through  S, . These  wi thin-component 
patterns  of  responding  are  in  general  agreement  with  results  of  previous 
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studies  of  FI  performance  under  both  simple  (e  q . , Branch  and  Gollub, 

1974;  Ferster  and  Skinner,  1957;  Schneider,  1963)  and  second-order 
(_e.£. , Byrd,  1971;  Byrd  and  Marr,  1969;  Findley,  1962;  Gollub,  1958; 

Kelleher  and  Fry,  1962;  Malagodi  et  al . , 1973aj  Marr,  1971)  schedules  of 
food  presentation. 

Rates  and  patterns  of  responding  throughout  sequences  of  components 
were  dependent  upon  the  overall  schedule  according  to  which  the  completion 
of  components  resulted  in  shock  presentation.  Under  the  FI  8-min  schedule, 
rate  of  responding  was  low  in  S^,  increased  through  S^  and  S^,  then 
decreased  slightly. in  S^ . While  the  patterns  of  responding  were  usually 
positively  accelerated  in  S^  through  S ^ , they  were  progressively  more 
sharply  defined  during  successive  components,  becoming  more  typical  of 
those  ordinarily  maintained  under  simple  FI  schedul es--in  S^,  short  pauses 
were  often  followed  by  low-to-moderate,  relatively  constant  rates  of 
responding;  in  S£,  short  pauses  were  often  followed  by  high,  relatively 
constant  rates  of  responding;  while  in  , longer  initial  pauses,  charac- 
teristic of  simple  FI  performance,  were  followed  by  high  rates  of  responding. 

Changing  the  overall  schedule  from  FI  8-min  to  VR  yoked  resulted  in 
a decrease  in  rate  of  responding  in  S^.  Rate  of  completing  components 
increased  slightly  with  one  monkey  and  decreased  with  the  other,  but 
responding  throughout  the  sequence  of  components  was  well -maintained  with 
both  monkeys.  After  the  VR  yoked  phase,  performance  under  the  FI  8-min 
sequence  schedule  was  recaptured.  Changing  the  overall  schedule  to  FR  4 
resulted  in  large  decreases  in  overall  rate  of  responding  and  in  rate  of 
completing  components.  Prolonged  periods  of  ncnresponding  developed  in 
with  both  monkeys  and  in  S^,  as  well,  with  one  monkey. 
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These  changes  in  rates  and  patterns  of  responding  throughout  sequences 
of  components  are  in  general  agreement  with  results  of  previous  studies 
of  responding  under  similar  forms  of  second-order  schedules  of  food 
presentation.  The  characteristics  of  responding  maintained  under  the  FI 
and  FR  sequence  schedules  in  the  present  study  are  very  similar  to  those 
reported  by  Marr  (1971)  in  a comparison  of  FI  and  FR  sequence  schedules 
terminating  in  food  presentation.  Pauses  were  always  shorter  and  response 
rates  were  always  higher  in  the  early  components  of  FI  sequence  schedules 
than  in  the  early  components  of  FR  sequence  schedules  with  equivalent 
minimum  interfood  times.  Individual  component  response  rates  were  often 
highest  in  under  the  FI  sequence  schedules  while  they  were  always 

highest  in  under  the  FR  sequence  schedules.  The  finding  in  the  present 

study  that  early  component  pauses  were  considerably  shorter  under  the  VR 
than  under  the  FR  sequence  schedule  is  also  in  general  agreement  with 
the  results  of  previous  studies  that  have  compared  either  VR  and  FR 
exchange  schedules  of  token  presentation  or  VR  and  FR  sequence  schedules 
of  food  presentation.  Under  conditions  in  which  lever  presses  produced 
tokens  according  to  an  FR  20  schedule,  and  token  presentations  resulted 
in  the  opportunity  to  exchange  the  tokens  for  food  pellets  according  to 
either  VR  6 or  FR  6 exchange  schedules,  pauses  prior  to  the  initiation 
of  lever  pressing  were  shorter  under  the  VR  than  under  the  FR  exchange 
schedule  (Webbe  and  Malagodi,  1978).  Similarly,  the  prolonged  early 
component  pauses  engendered  under  a Seq  FR  5 (FI  15-sec)  schedule  were 
abolished  under  a Seq  VR  3 (FI  15-sec)  schedule  (Findley,  1962).  While 
the  comparison  between  VR  and  FR  exchange  schedules  of  token  presentation 
was  carried  out  at  the  same  average  parameter  value  (VR  6 versus  FR  6), 
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the  comparison  between  VR  and  FR  sequence  schedules  was  confounded  by 
differences  in  parameter  value  (VR  3 versus  FR  5),  and  subsequently 
by  differences  in  minimum  interreinforcement  times.  In  the  present 
study,  the  average  parameter  values  of  the  VR  and  FR  sequence  schedules 
were  only  slightly  different  (VR  3.2  or  VR  3.9  versus  FR  4).  An 
interpretation  of  the  differential  effects  of  the  VR  and  FR  schedules 
in  terms  of  different  minimum  intershock  times  is  therefore  unlikely. 

A more  likely  interpretation  of  the  better  maintenance  of  responding 
under  both  the  VR  and  FI  sequence  schedules  than  under  the  FR  sequence 
schedule  is  one  that  focuses  on  the  stimulus  functions  of  successive 
discriminative  stimuli  under  the  different  forms  of  sequence  schedule 
(cf. , Gollub,  1977;  Kelleher,  1966a/,  Kelleher  and  Gollub,  1962;  Marr, 

1969)  and  upon  the  generality  of  effects  of  schedule  variables  shown  to 
operate  in  controlling  responding  in  simpler  behavioral  situations  (cf . , 
Morse,  1966;  Zeiler,  1977).  Under  both  the  FI  8-min  and  VR  yoked  schedules 
in  the  present  study,  shock  presentation  was  occasionally  associated 
with  early  component  stimuli,  while  under  the  FR  4 schedule,  shock  pres- 
entation was  restricted  to  association  with  the  last  component  stimulus 
(S.j).  The  effects  of  associating  shock  presentation  with  early  component 
stimuli  (under  both  the  FI  and  VR  schedules)  in  the  present  study  closely 
mirror  the  effects  obtained  with  comparable  sequence  schedules  of  food 
presentation.  In  such  studies,  removing  the  restricted  association  of 
food  with  only  the  last  stimulus  in  a sequence  of  component  stimuli  has 
been  shown  to  increase  rates  of  responding  in  early  components  (<e.£. , 

Byrd,  1971;  Findley,  1962;  Kelleher  and  Fry,  1962;  Marr,  1971).  That 
this  effect  results  primarily  from  the  increased  discriminative  control 
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over  responding  in  the  presence  of  early  component  stimuli  is  suggested  by 
the  results  of  the  study  by  Byrd  (1971),  in  which  repetition  of  the  terminal 
component  stimulus  (S^)  during  all  odd-numbered  FI  1-min  components  of  5-  or 
7-unit  sequence  schedules  increased  rates  of  responding  in  the  odd-numbered 
components  only. 

The  comparison  between  FI  8-min  and  VR  yoked  schedules  in  the  present 
study  also  suggests  that  the  adjusting  (cf . , Ferster  and  Skinner,  1957; 

Kelleher,  Fry,  and  Cook,  1964;  Marr,  1971)  or  regenerating  (cf . , Zeiler, 

1977)  characteristics  of  FI  schedules  were  not  critical  in  the  maintenance 
of  increased  early  component  response  rates,  and  that  the  percentages  of 
shocks  which  occurred  in  the  presence  of  each  component  stimulus  did  not  alone 
control  the  unusual  response-rate  distribution  obtained  under  the  FI  8-min 
schedule.  The  fact  that,  under  FI  schedules,  the  number  of  responses  is  free 
to  vary  has  been  considered  an  important  determinant  of  the  high  average  num- 
ber of  responses  (£.£.,  Herrnstein  and  Morse,  1958),  and  of  the  interval-to- 
interval  variations  in  number  of  responses  and  pause  durations  (£.£. , Dews, 
1970;  Shull,  1971;  Shull,  Guilkey,  and  Witty,  1972;  Zeiler,  1977)  typically 
observed  under  these  schedules.  Since  the  number  of  responses  per  reinforcer 
is  a function  of  the  organism's  performance,  and  not  of  a predetermined  require 
ment,  FI  schedules  may  arrange  for  a reinforcer  to  be  delivered  "just  when  it 
is  needed  to  revive  weak  behavior"  (Zeiler,  1977,  p.  212).  For  example,  when- 
ever rate  of  responding  is  low,  a reinforcer  will  follow  relatively  few 
responses;  this  may  in  turn  increase  rate  of  responding  in  subsequent  intervals 
The  characteristics  of  the  Seq  FI  8-min  (FI  2-min)  schedule  are  similar  to 
those  of  simple  FI  schedules  in  that  the  number  of  components  is  free  to  vary 
from  one  to  four,  and  the  exact  number  of  components  per  shock  presentation  is 
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determined  by  the  rate  and  pattern  of  responding.  Under  the  Seq  VR  yoked 
(FI  2-min)  schedule  the  number  of  components  per  shock  presentation  is  prede- 
termined. Since  responding  was  wel 1 -maintained  under  both  the  FI  and  VR 
sequence  schedules,  it  does  not  appear  necessary  that  the  probability  of 
shock  presentation  in  the  presence  of  a given  stimulus  be  determined  by  the 
organism's  behavior  for  early-component  shock  presentations  to  engender  high 
rates.  Since,  however,  rate  of  responding  in  S^  of  the  VR  schedule  was  lower 
than  in  S^  of  the  FI  schedule,  even  though  the  probabilities  of  shock  presen- 
tation in  each  component  stimulus  were  equated,  some  aspect  of  the  overall 
FI  8-min  schedule  seems  implicated  in  this  difference.  The  patterns  of 
responding  in  S^,  S^,  and  S^  of  the  FI  schedule  did  not  appear  as  sharply 
defined  , under  less  control  by  the  component  FI  2-min  schedule)  than 
did  the  pattern  of  responding  in  S^ , and  rates  of  responding  in  S^,  S^,  and 
S2  may  have  been  more  under  the  control  of  the  overall  FI  8-min  contingency 
than  under  control  of  FI  2-min  component  schedule.  Just  as  simple  fixed- 
interval  and  fixed-time  schedules  generate  the  lowest  rates  at  the  beginning 
of  intervals,  and  the  highest  rates  at  or  slightly  before  the  end  of  intervals 
(£.£.,  Branch  and  Gollub,  1974;  Ferster  and  Skinner,  1957;  Malagodi  et  al . , 
1978;  McKearney,  1974^,  Zeiler,  1968),  the  overall  FI  8-min  schedule  probably 
came  to  control  the  first  three  component  response  rates  in  a similar  fashion. 
Since  the  probability  of  shock  presentation  in  S-j  was  always  100  percent, 
responding  in  S-j  may  have  been  largely  under  the  control  of  the  component  FI 
2-min  schedule. 

In  addition  to  the  similarities  to  results  of  previous  studies  of  sequence 
schedules  of  food  presentation,  the  present  results  are  also  in  general  agree- 
ment with  those  of  previous  studies  of  performance  under  simple  FI,  VR,  and 
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FR  schedules  of  food  presentation.  Fixed-interval  schedules  that  maintain 
moderate  to  high  numbers  of  responses  per  reinforcement  (i_.£. , approximately 
250  responses  or  higher)  may  generate  higher  overall  response  rates  than 
FR  schedules  which  require  the  same  number  of  responses  (Ferster  and  Skinner, 
1957).  Variable-ratio  schedules  usually  generate  shorter  initial  pauses  and 
higher  overall  response  rates  than  FR  schedules  at  the  same  average  parameter 
value  (Ferster  and  Skinner,  1957;  cf . , Morse,  1966;  Zeiler,  1977).  Compari- 
sons between  simple  FI  and  VR  schedules,  matched  for  numbers  of  responses  per 
reinforcement,  have  not  been  carried  out,  but  the  present  results  suggest 
that  such  comparisons  may  possibly  show  smaller  differences  in  rate  cf  responding 
between  FI  and  VR  schedules  than  those  shown  between  FI  and  FR  or  between 
VR  and  FR  schedules. 

Several  aspects  of  the  present  results  can  also  be  related  to  those  ob- 
tained by  Byrd  (1972)  in  a study  of  second-order  schedules  of  shock  presenta- 
tion in  which  presentation  of  an  exteroceptive  stimulus  occurred  only  briefly 
at  completion  of  components.  In  one  phase  of  that  study,  completion  of  four 
successive  FI  4-min  components  was  required  for  shock  presentation  and  a 1-sec 
flash  of  light  was  presented  at  the  completion  of  each  component  (paired  stim- 
ulus-^). This  FR  4 (FI  4-min:S)  schedule  is  procedurally  similar  to  the 
Seq  FR  4 (FI  2-min)  schedule  in  both  type  of  component  schedule  (FI)  and  type 
and  parameter  value  of  overall  second-order  schedule  (FR  4).  Byrd  (1972)  found 
that  patterns  of  positively  accelerated  responding  were  maintained  in  all  com- 
ponents of  the  FR  4 (FI  4-min:S)  schedule.  Extended  pauses,  such  as  those 
that  occurred  in  the  present  study  during  the  early  components  of  the  Seq  FR  4 
(FI  2-min)  schedule  did  not  occur.  This  greater  effectiveness  of  brief- 
stimulus  procedures  versus  sequence  procedures  in  maintaining  responding 
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throughout  FR  sequences  of  FI  components  is  well  documented  by  results  of 
studies  that  have  used  second-order  schedules  of  food  presentation  (cf . , 
Findley,  1962;  Gollub,  1977;  Kelleher,  1966^,  b_;  Malagodi  et  al_. , 1973^, 

1975;  Stubbs,  1971).  The  present  results,  in  combination  with  those  of  Byrd 
(1972),  suggest  that  the  failure  to  maintain  responding  under  second-order 
paired-stimulus  schedules  of  shock  presentation  in  a previous  study  (Byrd, 

1969)  was  not  due  simply  to  the  complexity  of  the  experimental  procedures 
(see  Byrd,  1969,  1972  for  discussions  of  the  possible  reasons  for  the  failure 
to  maintain  responding). 

The  most  important  aspects  of  the  present  results  lie  perhaps  in  the 
very  complexity  of  the  behavioral  situations  in  which  responding  was_ well- 
maintained  by  response-dependent  presentations  of  noxious  electric  shock. 
Manipulations  of  schedule  variables  within  these  complex  behavioral  situa- 
tions produced  changes  in  responding  comparable  to  those  obtained  with  more 
typical  maintaining  events,  thus  extending  the  range  of  generality,  both  of 
the  phenomenon  of  shock-maintained  behavior  and  of  schedule-controlled  behav- 
ior in  general,  to  more  complex  situations.  The  present  results  also  provide 
some  support  for  Morse  and  Kelleher's  (1977)  suggestion  that  response- 
dependent  presentation  of  noxious  electric  shock  may  be  more  likely  to  enhance 
subsequent  responding,  thus  exemplifying  the  process  of  positive  reinforcement, 
when  there  has  been  a history  of  schedule-controlled  responding  and  when  that 
responding  is  multiply  determined.  While  previous  studies  have  indicated 
that  responding  under  simple  FR  schedules  of  electric  shock  presentation  may 
not  be  maintained  for  more  than  a few  sessions  (Kelleher  and  Morse,  1969; 
McKearne.y,  1970)  responding  under  the  Seq  FR  4 (FI  2-min)  schedule  was  main- 
tained with  one  monkey  in  the  present  experiment  for  over  50  sessions.  Many 


38 


important  phenomena  in  the  area  of  operant  behavior  were  revealed  only  after 
the  importance  intermittent  schedules  of  reinforcement  was  recognized  (cf . , 

Morse.  1966),  and  the  use  of  second-order  schedules  ("schedules  of  schedules') 
may  similarly  reveal  phenomena  which  are  present  at  still  more  complex  levels 
(cf . , Branch,  1977;  Findley,  1962). 

Previous  studies  of  shock-maintained  behavior  have  almost  uniformly 
employed  simple  (usually  FI)  schedules  of  shock  presentation.  This  prepon- 
derance of  simple  behavioral  preparations  has  probably  contributed  to  the 
ease  with  which  some  theorists  have  interpreted  the  phenomenon  of  shock- 
maintained  behavior  in  terms  of  relatively  simple  conceptualizations  borrowed 
from  other  areas  of  research.  Hutchinson  and  his  colleagues  (e.£. , Hutchinson, 
1977;  Hutchinson  and  Emley,  1972;  Hutchinson,  Renfrew,  and  Young,  1971)  have 
suggested  that  responding  maintained  under  intermittent  schedules  of  electric 
shock  presentation  may  be  a form  of  shock-elicited  behavior,  while  others 
(e.cj.,  Stretch,  1972)  have  suggested  that  such  responding  is  not  maintained  by 
the  presentation  of  electric  shock  per  se,  but  by  the  presentation  of  shock 
as  a signal  for  an  immediately  ensuing  "safe"  period  during  which  no  further 
shocks  are  forthcoming.  For  present  purposes  it  is  sufficient  to  note  that 
the  applicability  of  such  relatively  simple  conceptualizations  as  an  inter- 
pretation of  responding  in  the  complex  behavioral  situations  of  the  present 
study  is  severely  limited.  While  a comprehensive  theoretical  account  of 
shock-maintained  behavior  is  not  yet  possible,  the  present  results  add  to  the 
growing  body  of  literature  in  support  of  the  general  viewpoint  that  interactions 
among  previous  histories,  the  characteristics  of  ongoing  behavior  at  the  time 
at  which  an  event  is  introduced,  and  the  schedule  according  to  which  stimuli 
are  presented,  are  more  important  factors  than  the  intrinsic  properties  of  a 
given  stimulus  in  determining  whether  presentation  of  that  stimulus  will  either 
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maintain  or  suppress  responding  (cf . , Morse  and  Kelleher,  1970,  1977). 
That  such  seemingly  opposite  stimuli  as  food  arid  electric  shock  can  engen 
der  similar  rates  and  patterns  of  responding  when  they  are  scheduled  simi 
larly,  emphasizes  the  fundamental  importance  of  schedule  variables  in  the 
control  of  behavior. 
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